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Persistence  Search  -  A  New  Search  Strategy  For 
The  Dynamic  Shortest  Path  Problem 

Man-Tak  Shing(l)  and  Michael  M.  Mayer(2) 


ABSTRACT 

The  research  reported  in  this  paper  deals  with  the  problem  of  searching 
through  an  unknown  by  a  physical  agent  such  as  a  robot.  The  un¬ 

known  terrain  over  which  the  agent  will  travel  is  represented  by  an 
undirected  graph.  The  agent  has  no  prior  knowledge  of  the  graph.  It  can 
only  learn  about  its  environment  by  physically  roaming  it.  Given  a  starting 
location  s,  the  agent  tries  to  reach  a  target  location  r  using  the  minimum 
amount  of  physical  movement.  This  problem,  which  is  a  natural  generaliza¬ 
tion  of  the  classical  shortest  path  problem,  will  be  referred  to  as  the  dynamic 
shortest  path  problem.  Most  of  the  classical  shortest  path  algorithms  per¬ 
form  very  poorly  in  the  scenario  of  a  physical  agent  traversing  an  initially 
unknown  search  space.  They  do  not  attempt  to  minimize  the  amount  of 
physical  movement  required  by  the  agent  to  reach  the  goal  location.  In 
order  to  overcome  the  failings  of  these  search  algorithms  in  dealing  with 
searches  of  this  particular  nature,  a  new  search  strategy,  called  persistence 
search,  is  developed  and  presented  in  this  paper. 
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1.  INTRODUCTION 

One  of  the  central  problem-solving  techniques  in  AI  is  the  use  of  search.  In  this  paper, 
we  focus  our  attention  on  the  problem  of  searching  through  an  unknown  terrain  by  a  physical 
agent  such  as  a  robot.  The  unknown  terrain  over  which  the  agent  will  travel  is  represented  by 
an  undirected  graph.  The  agent  has  no  prior  knowledge  of  the  graph.  It  can  only  leant  about 
its  environment  by  moving  through  it.  Starting  at  a  given  vertex  s,  the  agent  tries  to  reach  a 
target  vertex  t  using  the  minimum  amount  of  physical  movement.  This  problem,  which  is  a 
natural  generalization  of  the  classical  shortest  path  problem,  will  be  referred  to  as  the  dynamic 
shortest  path  problem.  If  the  agent  has  prior  knowledge  of  the  entire  graph,  it  can  minimize 
its  physical  movement  by  first  computing  the  shortest  path  from  s  to  /  using  the  standard 
shortest  path  algorithms  and  then  moving  towards  l  along  the  shortest  path.  (See  for  exam¬ 
ple,  [2]  and  [3]  for  a  survey  of  the  shortest  path  algorithms.)  Without  complete  information 
of  the  entire  graph,  no  optimum  algorithm  (i.e.  one  that  always  produces  the  shortest  path 
from  s  to  t  in  any  given  graph)  can  exist.  The  reason  is  because,  without  prior  knowledge  of 
the  entire  graph,  the  agent  must  physically  roam  its  environment,  learning  about  it  by  sensing 
the  immediate  surroundings.  A  state  of  any  state-space  search  algorithm  now  depends  on 
both  the  current  physical  location  of  the  agent  and  the  total  amount  of  physical  movement  that 
has  been  made  already.  Since  the  energy  or  time  involved  in  physical  movement  cannot  be 
recovered  once  expended,  any  optimum  algorithm  must  require  the  agent  to  traverse  along  the 
shortest  path  from  s  to  t  at  all  times.  This  is  impossible  since  the  algorithm  does  not  have 
any  prior  knowledge  of  the  graph  to  start  with.  Hence,  any  algorithm  for  solving  the  dynamic 
shortest  path  problem  is  a  heuristic  algorithm.  Such  algorithm  is  considered  to  be  "good"  if  it 
produces  paths  which  are  not  much  longer  than  the  shortest  paths  most  of  the  time. 

Most  of  the  classical  shortest  path  algorithms  perform  very  poorly  in  the  scenario  of  a 
physical  agent  traversing  an  initially  unknown  terrain.  They  do  not  attempt  to  minimize  the 
amount  of  physical  movement  required  by  the  agent  to  reach  a  desired  goal  location.  These 
algorithms  ignore  the  physical  aspects  of  search,  measuring  the  quality  of  their  solutions  only 
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by  the  amount  of  computation  required.  In  order  to  overcome  the  failings  of  these  search 
algorithms  in  dealing  with  searches  of  this  particular  nature,  new  search  strategies  and  new 
measures  for  evaluating  such  strategies  are  needed. 

One  measure  for  comparing  the  performance  of  the  algorithms  for  dynamic  problems  is 
the  ratio 

^  _  the  total  distance  traversed  by  the  agent 
the  length  of  the  shortest  path  from  s  to  t 

In  [4],  Papdimitriou  and  Yannakakis  studied  several  versions  of  the  dynamic  shortest 
path  problem.  They  have  devised  search  strategies  that  optimize  the  ratio  R  foi  uv  sp<»ciai 
cases:  layered  graph  with  bounded  width  and  two-dimensional  scenes  with  unit  square  obsta¬ 
cles.  They  further  showed  that  no  bounded  ratio  is  possible  for  slightly  more  general  graphs 
and  scenes,  and  the  computational  problem  of  devising  optimal  search  strategies  for  the 
dynamic  shortest  path  is  PSPACE-Complete.  Hence,  a  new  heuristic  search  sr  itegv,  called 
persistence  search ,  is  developed  and  presented  in  this  paper  to  tackle  the  dynamic  shortest 
path  problem  for  genera!  graphs. 

2.  PERSISTENCE  SEARCH 

As  stated  in  the  previous  section,  the  agent  begins  with  no  knowledge  of  the  graph.  It 
can  learn  about  the  graph  by  moving  from  vertex  to  vertex  via  the  edges  incident  to  the  ver¬ 
tices,  and  it  can  remember  the  vertices  and  edges  which  it  has  explored  by  dropping  markers 
along  the  way  [1].  At  each  vertex  v,  the  agent  has  the  ability  to  discover  all  the  edges 
incident  to  the  vertex  v .  Additionally,  for  each  unexplored  edge  incident  to  v ,  the  agent  has 
some  estimation  of  the  distance  from  the  vertex  v  to  the  target  vertex  t  via  the  unexplored 
edge.  Starting  at  the  vertex  s ,  persistence  search  directs  the  agent  towards  the  destination  ver¬ 
tex  t  as  follows: 
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(8  )  Else  Begin 

(9  )  For  each  unexplored  edge  (c ,  w )  do 

(10)  Begin 

(11)  If  w  is  explored  Then  mark  the  edge  (c,w)  as  explored 

(12)  Else  add  the  edge  (c ,  w)  to  the  set  L . 

(13)  End. 


(14)  If  L  is  not  empty 

(15)  Then  Begin 

(16)  Among  the  frontier  edges  in  L,  find  the  frontier  edge  e  that  minimizes 

the  equation 

/ (e)  =  pf  x  g(v)  +  h(e)  ,  (1) 

where  v  is  the  explored  vertex  adjacent  to  e .  g  (v )  is  the  shortest 
distance  from  c  to  v  using  only  edges  in  the  explored  subgraph, 
h  (e )  is  the  estimated  future  cost  of  e ,  which  is  the  lower  bound 


estimate  for  the  distance  from  v  to  r  via  the  unexplored  edge  e , 
and  pf  is  the  persistence  factor ,  a  real  number  between  0.0 
and  1.0  for  discounting  the  cost  of  "backtracking”  to  the  frontier 
edge  e. 


(17) 
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Move  the  agent  from  c  to  v  along  the  shortest  path  using  only  edges 
in  the  explored  subgraph. 

(18)  Mark  the  edge  e  explored. 

(19)  Let  w  be  the  vertex  at  the  other  end  of  e .  Move  the  agent  along  e  low. 

(20)  c  :=  w; 

(21)  End 

(22)  Else  EXIT  :=  TRUE  /*  search  has  failed  */ 

(23)  End 

(24)  Until  EXIT; 

End. 

While  the  above  algorithm  is  very  close  to  the  algorithm  for  A*  search  [5],  one  should 
note  the  subtle  but  important  differences.  The  function  g(v)  is  computed  from  the  current 
vertex  c  to  v,  rather  than  from  the  initial  starting  vertex  s.  This  is  a  logical  choice  for  g(v) 
since  the  agent  must  be  moved  physically  from  the  current  position  c  to  the  vertex  v  before  it 
can  resume  its  exploration  from  v . 

A  second  difference  is  in  the  use  of  the  persistence  factor  pf  to  bias  the  cost  function 
g(v).  The  persistence  factor  varies  between  0.0  and  1.0  and  serves  to  discount  tlK  cost  of 
"backtracking"  versus  estimated  future  cost,  h(e).  By  varying  the  persistence  factor,  the 
behavior  of  the  persistence  search  can  be  dramatically  altered.  When  the  persistence  factor  is 
0,  the  cost  of  "backtracking"  from  one  vertex  to  another  becomes  zero  and  the  formula  for 
rating  the  frontier  edges  reduces  to: 

fie)  =  h{e)  (2) 

which  is  equivalent  to  that  used  for  best-first  search  [5].  Each  frontier  edge  is  ranked  only 
according  to  its  estimated  future  cost.  The  agent  will  move  about  the  explored  search  space 
without  regard  for  the  amount  of  physical  movement  required,  traversing  to  whichever  vertex 
is  closest  to  goal. 
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When  the  persistence  factor  is  equal  to  1,  persistence  search  behaves  more  like  hill¬ 
climbing  search  [5],  Since  the  cost  of  moving  from  the  current  vertex  to  another  vertex  in 
the  explored  subgraph  becomes  more  expensive,  the  agent  tends  to  be  more  persistent  in  con¬ 
tinuing  the  exploration  from  a  vertex  neater  to  the  present  location. 


3.  SEARCHING  THROUGH  A  RECTILINEAR  MAZE 

As  an  initial  step  in  evaluating  the  performance  of  the  proposed  algorithm,  persistence 
search  is  used  to  tackle  a  restricted  version  of  the  dynamic  shortest  problem:  the  case  of  an 
agent  traversing  a  random  rectilinear  maze. 

The  unknown  terrain  over  which  the  agent  will  travel  is  represented  by  a  rectilinear 
graph  or  grid-graph  as  shown  in  Figure  1. 


(a)  a  rectilinear  maze  (b)  the  corresponding  grid-graph 

Figure  1 

Vertices  are  arranged  in  a  rectangular  fashion  with  edges  connecting  vertices  immedi¬ 
ately  above,  below,  right  and  left  (north,  south,  east  and  west  respectively),  and  the  vertices 
are  distinguished  from  one  another  by  their  X  and  Y  coordinates.  Locations  within  the  maze 
are  either  passable  or  impassable.  Impassable  locations  in  the  maze  are  represented  by 
disconnected  vertices  in  the  graph,  making  them  unreachable  from  any  direction. 
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The  agent  begins  with  no  knowledge  of  the  graph.  It  can  learn  about  the  graph  only  as 
it  moves  from  vertex  to  vertex  via  the  edges  connecting  them.  The  agent’s  ability  to  sense  its 
surroundings  is  limited  to  determining  whether  the  immediate  neighbors  of  the  current  vertex 
are  passable  or  impassable.  Since  the  terrain  is  a  grid-graph,  the  agent  is  only  able  to  move 
and  survey  in  the  four  cardinal  directions. 

Additionally,  the  agent  knows  its  position  relative  to  the  goal.  Several  different  means 
could  be  used  to  accomplish  this.  If  the  agent  initially  knows  the  goal’s  position  relative  to 
its  own,  it  can  maintain  this  knowledge  through  dead  reckoning  as  it  moves  about  the  maze 
from  its  initial  starting  point.  Using  this  information,  the  agent  can  determine  the  rectilinear 
distances  from  the  goal  to  its  current  location  as  well  as  to  any  of  the  passable  locations  adja¬ 
cent  to  its  current  location.  Rectilinear  distance  is  a  lower  bound  for  the  number  of  steps 
necessary  to  move  from  the  current  position  to  the  goal.  The  rectilinear  distance  from  a  ver¬ 
tex  v  to  the  goal  r  can  be  computed  using  the  formula 

\XV  -  Xt  I  +  \YV  -  Yt  i 

where  (Xv,  yv)  and  (X,,  Yt)  are  the  coordinates  of  v  and  t  respectively. 

We  can  also  direct  the  agent  to  the  goal  using  either  an  active  guidance  system  like  radar 
or  a  passive  guidance  system  like  a  beaconing  system.  While  only  lines  of  bearing  are 
required  to  choose  which  immediate  neighbor  is  closer  to  the  goal,  the  goal's  exact  location  is 
needed  to  totally  order  the  search  space.  If  the  goal  is  northeast  of  the  current  location,  then 
the  immediate  neighbors  to  the  north  and  the  east  are  closer  to  the  goal  and  have  the  same 
rectilinear  distance  to  the  goal.  However,  when  comparing  widely  separated  locations,  a  rank¬ 
ing  for  the  locations  based  on  their  closeness  to  the  goal  cannot  be  determined  without  the 
exact  location  of  the  goal.  If  location  P  is  north  of  the  goal  and  location  Q  is  south  of  the 
goal,  there  is  no  static  way  to  tell  which  one  is  closer  merely  by  their  relative  direction  to  the 
goal.  However,  by  triangulating  lines  of  bearing  taken  from  different  locations,  the  exact 
location  of  the  goal  can  be  determined. 
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Since  tv.  edges  in  the  grid-graph  all  have  equal  length,  we  can  assume  that  the  agent 
alway;,  '  ,ows  the  cost  of  traversing  an  unexplored  edge.  Hence,  instead  of  keeping  track  of  a 
set  of  frontier  edges,  we  can  simplify  the  implementation  of  the  algorithm  by  keeping  track  of 
the  set  of  unexplored  vertices  that  are  adjacent  to  the  frontier  edges.  The  algorithm  for 
searching  through  an  unknown  rectilinear  maze  is  as  follows: 

Algorithm  II 
Begin 

(1  )  EXIT  :=  FALSE; 

(2  )  c  :=  s  \  /*  c  denotes  the  current  position  of  the  agent  */ 

(3  )  L  :=  };  /*  L  denotes  the  set  of  vertices  to  be  explored,  called  frontier  vertices  *! 

(4  )  Repeat 

(5  )  Remove  c  from  L. 

(6  )  Mark  the  vertex  c  explored. 

(7  )  rf  c  =  t 

(8  )  Then  EXFT  :=  TRUE  /*  search  has  succeeded  */ 

(9  )  Else  Begin 

(10)  L  :=  L  (  the  set  of  unexplored  immediate  neighbors  of  c  |. 

(11)  If  L  is  not  empty 

(12)  Then  Begin 

(13)  Among  the  frontier  vertices  in  L ,  find  the  frontier  vertex  v  that 

minimizes  the  equation 

/(v)  =  pf  x  g(v)  +  h(v)  ,  (3) 

where  g  ( v )  is  the  shortest  distance  from  c  to  v  using  only 
paths  with  explored  vertices  as  intermediate  vertices,  /i(v)  = 

I  Xv  -  X,  I  +  1  Yv  -  Y,  !,  and  pf  is  the  persistence  factor 
with  value  between  0.0  and  1.0. 


(14) 
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Mov-  the  agent  from  c  to  v  along  the  shortest  path  using  only 
explored  vertices  as  intermediate  vertices. 

(15)  c  :=  v; 

(16)  End 

(17)  Else  EXIT  :=  TRUE  /*  search  has  failed  */ 

(18)  End 

(19)  Until  EXIT; 

End. 


In  order  to  reduce  the  computation  required  by  persistence  search,  we  further  modify  the 


algorithm  as  follows: 

Algorithm  III 

Begin 

(1  ) 

EXIT  :=  FALSE; 

(2  ) 

c  :=  s  ;  /*  c  denotes  the  current  position  of  the  agent  */ 

(3  ) 

L  :=  {.v  );  /*  L  denotes  the  set  of  vertices  to  be  explored,  called  frontier  vertex  */ 

(4  ) 

Repeat 

(5  ) 

Remove  c  from  L . 

(6  ) 

Mark  the  vertex  c  explored. 

(7  ) 

If  c  =  t 

(8  ) 

Then  EXIT  :=  TRUE  /*  search  has  succeeded  */ 

(9  ) 

Else  Begin 

(10) 

L  :=  L  \^j  (  the  set  of  unexplored  immediate  neighbors  of  c  ). 

(ID 

If  c  has  an  unexplored  immediate  neighbor  w  such  that  h{w)  < 

h(c) 

where  hiw)  and  h(c)  denote  the  rectilinear  distances  from  w 

and  c 

to  the  goal  location  /  respectively 

(12) 


Then  c  w  and  move  the  agent  to  the  vertex  w 


Else  If  L  is  not  empty 
Then  Begin 
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(13) 

(14) 

(15) 


(16) 


Among  the  frontier  vertices  in  L ,  find  the  frontier  vertex  v  that 
minimizes  the  equation 

/(v)  =  pf  x  g(v)  +  h(v)  , 

where  g  (v )  is  the  shortest  distance  from  c  to  v  using  only 
paths  with  explored  vertices  as  intermediate  vertices,  h(v)  = 
\XV  -  X,  I  +  I  Yv  -  Y,  I,  and  pf  is  the  persistence  factor 
with  value  between  0.0  and  1 .0. 

Move  the  agent  from  c  to  v  along  the  shortest  path  using  only 
explored  vertices  as  intermediate  vertices. 


(17)  c  :=  v; 

(18)  End 

(19)  Else  EXIT  :=  TRUE  /*  search  has  failed  */ 

(20)  End 

(21)  Until  EXIT; 

End. 


Now,  the  agent  always  moves  to  the  immediate  neighbor  w  of  the  current  vertex  c  if 
h(w',  <  h(c)  (lines  11-12  in  Algorithm  III).  A  simple  north,  east,  south,  west  preference 
serves  as  a  heuristic  to  break  ties  between  neighbors  of  equal  estimated  future  cost.  This 
modification  greatly  reduces  the  computation  required  by  the  agent  since  it  no  longer  has  to 
examine  the  list  of  frontier  vertices  whenever  c  has  an  immediate  neighbor  with  a  cheaper 
future  cost.  Algorithm  III  can  be  regarded  as  a  hybrid  of  hill  climbing  search  and  persistence 
search.  Note  that  when  pf  =  1,  the  physical  moves  produced  by  Algorithms  II  and  III  are 
identical  for  all  rectilinear  mazes.  When  pf  <  1,  Algorithms  II  and  III  only  produced  identi¬ 
cal  moves  for  rectilinear  tree  mazes,  i.e.  mazes  without  circuits. 
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4.  EVALUATING  THE  PERFORMANCE  OF  THE  ALGORITHMS 

There  are  two  factors  governing  the  performance  of  the  proposed  algorithms:  the  compu¬ 
tational  efficiency  of  the  algorithms  and  the  quality  of  the  solutions  produced.  As  mentioned 
in  Section  1,  the  quality  of  the  solution  can  be  measure  by  the  error  ratio  R,  which  is  equal  to 

the  total  number  of  edges  traversed  by  the  agent  to  reach  the  goal 
the  length  of  the  shortest  path  from  s  to  t  in  the  entire  maze 

The  computational  efficiency  of  the  algorithms  can  be  measured  by  counting  the  total  number 
of  current  vertices  examined  plus  the  total  number  of  vertices  examined  while  computing  the 
shortest  paths  from  a  current  vertex  back  to  the  frontier  vertices  via  the  explored  subgraph. 

Given  any  integer  n  and  any  pf  value  between  0.0  and  1.0,  one  can  always  come  up 
with  a  worst-case  maze  with  n  vertices  that  requires  0(rt2)  vertex-examinations  and  the  solu¬ 
tion  produced  by  the  algorithms  has  an  O(n)  error  ratio.  Figure  2  shows  two  worst-case 
examples  one  for  the  pf  value  of  0  and  the  other  for  the  pf  value  of  1 . 


(a)  a  worst-case  example  for  pf  =  0.0  (b)  a  worst-case  example  for  pf  -  1.0 

Figure  2 

While  the  agent  may  have  to  visit  every  vertex  in  the  graph  before  finding  the  goal  in 
the  worst-case,  the  total  distance  traversed  by  the  agent  may  be  substantially  lower  on  the 
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average.  In  order  to  better  judge  the  performance  of  the  persistence  search  algorithms,  we 
have  implemented  Algorithms  II  and  III  as  well  as  a  hill-climbing  search  algorithm  in  the  C 
programming  language  and  applied  the  algorithms  to  a  large  set  of  random  mazes  generated 
by  the  algorithm  described  in  the  next  section. 

4.1  MAZE  GENERATION 

The  random  maze  generator  operates  in  two  modes,  creating  mazes  with  or  without 
cycles.  The  mazes  without  cycles  can  be  naturally  represented  as  trees  and  those  with  cycles 
can  be  represented  as  graphs.  We  have  separated  the  tree  mazes  from  the  nontree  mazes 
because  of  the  way  persistence  search  backtracks.  When  backtracking,  persistence  search 
always  travels  to  the  cheapest  frontier  vertex  (i.e.  the  frontier  vertex  with  the  cheapest  com¬ 
bined  cost)  along  the  shortest  path  in  the  explored  subgraph.  This  gives  persistence  search  an 
extra  advantage  over  hill-climbing  search.  The  hill-climbing  search,  being  a  variant  of  depth- 
first  search,  does  not  take  short-cuts  and  always  traces  back  to  the  cheapest  frontier  vertex 
along  the  path  from  which  it  came.  In  non-tree  mazes,  this  results  in  a  large  amount  of  back 
and  forth  movement  by  the  hill-climbing  search  algorithm  as  it  winds  its  way  out  of  large 
open  areas.  This  inefficient  behavior  can  be  seen  clearly  in  Figure  3,  where  the  hill-climbing 
search  requires  the  agent  (which  at  vertex  13)  to  visit  all  blank  vertices  before  backtracking  to 
vertex  14,  while  persistence  search  allows  the  agent  to  go  from  vertex  13  to  vertex  14  via  ver¬ 
tex  s  in  two  mechanical  steps.  If  the  maze  is  a  tree,  there  are  no  circuits  and  persistence 
search  no  longer  has  such  an  advantage. 

The  maze  generation  algorithm,  makemaze,  uses  a  depth-first  algorithm  to  create  a  ran¬ 
dom  path  through  an  initially  empty  maze,  placing  obstacles  at  intervals  along  its  path  accord¬ 
ing  to  a  parameter  called  maze  density.  Makemaze  begins  by  laying  obstacles  along  the  boun¬ 
dary  of  the  rectangular  maze.  It  then  picks  a  random  starting  point  within  the  maze.  The 
algorithm  maintains  a  trail  of  the  locations  in  the  maze  it  has  explored. 
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Figure  3 


At  each  step  along  its  path,  it  randomly  determines  whether  it  must  turn  from  its  current 
direction.  If  so,  it  places  an  obstacle  in  the  direction  it  was  going  and  continues  on  in  a  ran¬ 
dom  new  direction.  The  higher  the  maze  density,  the  more  likely  it  is  that  the  path  will  turn 
and  an  obstacle  will  be  created.  If  the  maze  generator  becomes  "blocked"  by  its  own  trail  or 
obstacles,  it  backtracks  along  its  original  trail  until  it  comes  to  a  new  location  and  resumes  its 
exploration. 

If  makemaze  is  restricted  to  creating  mazes  which  are  trees,  it  must  also  check  to  see  if 
the  next  location  it  is  going  to  explore  will  create  a  cycle  in  the  maze.  If  so,  it  places  an  obs¬ 
tacle  there  instead  and  chooses  a  new  direction.  Hence,  there  is  only  one  path  between  any 
two  vertices  in  a  tree  maze. 

4.2  THE  HILL-CLIMBING  SEARCH 

For  comparison  with  persistence  search,  a  hill-climbing  search  algorithm  was  imple¬ 
mented.  We  chose  to  compare  the  proposed  algorithm  against  the  hill-climbing  search 
because  the  hill-climbing  search  (or  some  other  depth-first  search  variant)  is  the  only 
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reasonable  alternative  to  persistence  search  in  guiding  a  physical  agent  through  an  unknown 
bounded  terrain.  The  other  alternatives,  like  best-first  search  or  some  variants  of  A*  search, 
require  too  much  movement  on  the  part  of  the  physical  agent,  causing  it  to  physically 
crisscross  known  search  space  to  expand  new  vertices. 

The  hill-climbing  search  algorithm  is  very  similar  to  the  algorithm  used  to  create  the 
maze,  as  they  both  are  variants  of  the  depth-first  search  algorithm.  The  hill-climbing  search 
algorithm  uses  a  simple  stack  to  keep  track  of  its  current  path  and  a  bitmap  to  mark  the  ver¬ 
tices  it  has  visited.  It  places  the  unexplored  immediate  neighbors  of  the  vuiicnt  vertex  on  the 
stack  according  to  the  non-increasing  order  of  their  estimated  future  costs,  leaving  the  one 
with  the  cheapest  estimated  future  cost  on  the  top  of  the  stack.  It  then  pops  a  vertex  off  the 
stack,  updates  the  current  vertex  and  moves  the  physical  agent  to  the  new  current  vertex. 

4.3  SPEEDING  UP  THE  PERSISTENCE  SEARCH 

A  major  portion  of  the  computation  is  spent  in  Line  13  of  Algorithm  II  and  Line  15  of 
Algorithm  III  for  finding  the  shortest-path  from  the  current  vertex  to  the  cheapest  frontier  ver¬ 
tex  in  the  list  L.  Since  the  edges  in  the  grid-graph  all  have  equal  length,  a  simple  breadth- 
first  search  (BFS)  is  used  to  scan  the  explored  subgraph  for  the  cheapest  frontier  vertex  each 
time  the  list  L  has  to  be  examined.  In  order  to  reduce  the  time  required  to  compute  these 
shortest  paths,  "branch-and-bound"  is  introduced  into  the  breadth-first  search  as  follows.  At 
the  beginning  of  the  BFS,  the  lower  bound  for  the  cheapest  combined  cost  is  initialized  to  the 
smallest  estimated  future  cost  of  all  the  frontier  vertices  in  L  and  the  upper  bound  for  the 
cheapest  combined  cost  is  initialized  to  positive  infinity  (or  some  very  large  positive  number). 
During  the  course  of  the  search,  the  upper  bound  for  the  cheapest  combined  cost  is  set  to  the 
lowest  combined  cost  of  the  frontier  vertices  visited  so  far  while  the  lower  bound  for  the 
cheapest  combined  cost  is  set  to  the  sum  of  the  current  depth  reached  by  BFS  plus  the 
cheapest  estimated  future  cost  among  all  frontier  vertices  in  L.  To  keep  track  of  the  smallest 
estimated  future  cost  among  all  the  frontier  vertices  in  L,  the  vertices  in  L  are  maintained  in 
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the  form  of  a  min-heap,  with  the  frontier  vertex  which  has  the  smallest  estimated  future  cost 
on  top.  The  min-heap  is  updated  whenever  vertices  are  added  to  or  deleted  from  L.  The 
search  terminates  when  the  lower  bound  is  greater  than  or  equal  to  the  upper  bound,  thus  sig¬ 
naling  that  the  frontier  vertex  with  the  lowest  combined  cost  has  been  found.  The  agent  can 
then  traverse  from  the  current  vertex  c  to  the  frontier  vertex  v  via  the  search  tree  constructed 
by  BFS. 

4.4  THE  EXPERIMENTAL  RESULTS 

Two  experiments  were  conducted  to  study  the  performance  of  the  proposed  algorithms. 
In  the  first  experiment,  a  total  of  8000  runs  were  performed  and  analyzed  empirically.  Input 
to  the  first  experiment  was  generated  as  follows.  Two  thousand  mazes,  in  groups  of  50,  were 
created  using  the  algorithm  described  in  Section  4.1.  The  mazes  in  each  group  were  gen¬ 
erated  based  on  a  unique  combination  of  maze  type,  maze  density  and  dimension  of  the 
underlying  rectangular  grid.  (See  Table  I  for  a  summary  of  the  mazes.)  Two  pairs  of  pass¬ 
able  locations  were  chosen  from  each  maze,  and  two  experimental  runs  were  performed  for 
each  of  the  location  pair  la,  b]  chosen,  once  from  a  to  b  and  once  from  b  to  a . 

The  results  of  the  first  experiment  are  summarized  in  Tables  2-7.  From  the  experimental 
results,  one  can  conclude  that  persistence  search  (both  Algorithms  II  and  III)  outperforms 
hill-climbing  search  for  both  nontree  mazes  and  tree  mazes  (Tables  2a,  2b,  3a  and  3b).  The 
solutions  produced  by  Algorithms  II  and  III  are  equally  good  (Tables  4a  and  4b)  but  Algo¬ 
rithm  III  runs  much  faster  than  Algorithm  II  (Tables  6a,  6b,  7a  and  7b). 

For  nontree  mazes,  Algorithm  III  achieves  its  best  results  when  the  persistence  factor  is 
between  0.4  and  0.6,  producing  solutions  that  are  at  most  1.45  times  as  long  as  the  best  possi¬ 
ble  solutions  for  sparse  nontree  mazes  (mazes  with  density  <  0.5)  and  6.5  times  as  long  as  the 
best  possible  solutions  for  dense  nontree  mazes  (mazes  with  density  =  0.9).  Moreover,  these 
performance  ratios  grow  very  slowly  when  compared  to  the  growth  rate  of  the  sizes  of  the 
search  space.  Table  7a  shows  the  computational  overhead  of  Algorithm  III  for  nontree  mazes. 
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For  persistence  factors  between  0.4  and  0.6,  Algorithm  III  takes,  on  the  average,  between  15 
to  24  computational  steps  for  each  physical  step  produced,  which  is  an  acceptable  trade-off 
given  today’s  high-speed  computers.  (A  computational  step  corresponds  to  either  a  vertex 
examination  or  a  heap  operation.  Each  vertex  examination  involves  marking  the  vertex  as 
visited  and  adding  the  vertex’s  unvisited  neighbors  to  the  agenda,  and  each  heap  operation 
involves  comparing  a  node  against  its  parent  and  interchanging  the  positions  of  the  two 
nodes.)  Table  5a  shows  the  comparisons  between  the  solutions  produced  by  Algorithm  III  and 
hill-climbing  search  for  nontree  mazes.  Algorithm  III  clearly  outperforms  hill-climbing  search 
in  terms  of  both  the  frequency  of  producing  better  solutions  and  the  average  length  of  the 
solutions  produced. 

For  tree  mazes,  Algorithm  III  achieves  its  best  results  when  the  persistence  factor  is 
between  0.2  and  0.4.  Although  the  paths  for  tree  mazes  produced  by  Algorithm  III  are  on  the 
average  shorter  than  those  produced  by  hill-climbing  search  (Table  3b),  Algorithm  III  only 
produces  better  solutions  30%  percent  of  the  time  (Table  5b).  This  discrepancy  is  due  to  the 
anomalous  behavior  of  the  hill-climbing  search.  Hill-climbing  search  actually  produces  paths 
that  are  shorter  than  the  corresponding  average  path  lengths  Rh  over  75%  of  the  time.  Unfor¬ 
tunately,  there  are  always  five  to  ten  runs  in  each  maze  group  that  cause  hill-climbing  search 
to  produce  paths  that  are  fifty  to  a  hundred  times  longer  than  the  average  lengths.  Persistence 
search,  on  the  other  hand,  always  produces  paths  with  lengths  distributed  uniformly  around 
the  corresponding  average  path  lengths  Rjlt.  Hence,  persistence  search  should  be  used  if  one 
wants  a  good  worst-case  performance  at  the  expense  of  longer  computational  time  ~  Algo¬ 
rithm  III,  with  persistence  factors  between  0.2  and  0.4,  takes  on  the  average  as  high  as  85 
computational  steps  for  each  physical  step  produced. 

In  order  to  better  understand  how  persistence  factor  affects  the  performance  of  per¬ 
sistence  search  for  nontree  mazes,  another  7000  runs  were  performed  and  analyzed  empiri¬ 
cally.  (See  Table  8  for  a  summary  of  the  input  data.)  The  results  of  the  second  experiment 
are  summarized  in  Tables  9-11.  For  all  the  nontree  mazes  tested,  Algorithm  III  seems  to 
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perform  equally  well  with  different  persistence  factors  between  0.4  and  0.6.  More  important, 
the  performance  ratios  remain  fairly  constant  with  respect  to  the  increasing  sizes  of  the  search 
space.  Hence,  one  can  conclude  from  the  experimental  results  that  persistence  search  with 
persistence  factor  between  0.4  and  0.6  is  indeed  a  very  good  heuristic  algorithm  for  searching 
through  unknown  nontree  mazes. 

5.  CONCLUSIONS 

In  this  paper,  a  new  search  strategy  is  proposed  to  minimize  the  total  distance  traversed 
by  an  agent  in  search  of  the  target  location.  In  light  of  our  experimental  results,  persistence 
search  is  a  very  good  strategy  for  searching  unknown  nontree  mazes.  The  success  of  per¬ 
sistence  search  comes  from  its  ability  to  cut  across  its  own  path  to  take  advantage  of  the  short 
circuits  in  the  terrain,  as  well  as  the  use  of  the  persistence  factor  to  discount  the  cost  of  aban¬ 
doning  the  current  location  in  order  to  continue  the  exploration  somewhere  else.  This  is  par¬ 
ticularly  useful  in  exploring  unknown  unbounded  mazes.  Persistence  search  (with  persistence 
factor  less  than  one)  always  finds  the  goal  as  long  as  it  is  reachable  from  the  starting  location, 
while  hill-climbing  search  may  make  a  wrong  turn  and  miss  the  goal  forever.  Persistence 
search  is  the  preferred  strategy  for  searching  tree  mazes  if  one  wants  to  minimize  the  worst- 
case  path  length.  One  way  to  improve  the  computational  efficiency  of  persistence  search  for 
tree  mazes  is  to  modify  persistence  search  so  that  it  behaves  like  hill-climbing  search  most  of 
the  time  and  only  evaluates  the  possibility  of  backtracking  to  another  frontier  vertex  once 
every  K  mechanical  steps  for  some  large  constant  K. 
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number 

maze 

grid 

avg.  number  of 

avg.  length  of 

of  mazes 

density 

dimension 

passable  cells 

the  shortest  paths 

(1) 

nontree 

50 

0.1 

128  x  128 

14734.38 

84.76 

(2) 

nontree 

50 

0.1 

192  x  192 

33503.52 

120.84 

(3) 

nontree 

50 

0.1 

256  x  256 

59866.72 

167.34 

(4) 

nontree 

50 

0.1 

320  x  320 

93830.20 

215.70 

(5) 

nontree 

50 

0.3 

128  x  128 

13137.48 

90.35 

(6) 

nontree 

50 

0.3 

192  x  192 

29875.64 

142.60 

(7) 

nontree 

50 

0.3 

256  x  256 

53382.76 

175.55 

(8) 

nontree 

50 

0.3 

320  x  320 

83697.34 

218.54 

(9) 

nontree 

50 

0.5 

128  x  128 

11821.24 

89.10 

(10) 

nontree 

50 

0.5 

192  x  192 

26889.66 

138.35 

(ID 

nontree 

50 

0.5 

256  x  256 

48046.98 

176.68 

(12) 

nontree 

50 

0.5 

320  x  320 

75283.82 

240.48 

(13) 

nontree 

50 

0.7 

128  x  128 

10475.96 

(14) 

nontree 

50 

0.7 

192  x  192 

23843.44 

(15) 

nontree 

50 

0.7 

256  x  256 

42594.08 

(16) 

non  tree 

50 

0.7 

320  x  320 

66799.02 

(17) 

50 

0.9 

128  x  128 

7808.36 

(18) 

nontree 

50 

0.9 

192  x  192 

17914.74 

(19) 

nontree 

50 

0.9 

256  x  256 

32259.48 

(20) 

nontree 

50 

0.9 

320  x  320 

50661.42 

(21) 

tree 

50 

0.1 

128  x  128 

8884.88 

(22) 

tree 

50 

0.1 

192  x  192 

20156.64 

(23) 

tree 

50 

0.1 

256  x  256 

35960.40 

(24) 

tree 

50 

0.1 

320  x  320 

56326.42 

(25) 

tree 

50 

0.3 

128  x  128 

9077.72 

(26) 

tree 

50 

0.3 

192  x  192 

20608.66 

(27) 

tree 

50 

0.3 

256  x  256 

36778.46 

(28) 

tree 

50 

0.3 

320  x  320 

57575.86  “r 

106.90 


162.74 


205.43 


249.33 


177.92 


226.88 


300.98 


384.26 


720.03 


1554.56 


2536.39 


3259.97 


869.04 


1932.15 


2878.34 


4719.78 


(29) 

tree 

50 

0.5 

128  x  128 

8890.08 

875.58 

(30) 

tree 

50 

0.5 

192  x  192 

20222.80 

.  1929.14 

(31) 

tree 

50 

0.5 

256  x  256 

36088.92 

2961.83 

(32) 

tree 

50 

0.5 

320  x  320 

56561.28 

3924.45 

(33) 

tree 

50 

0.7 

128  x  128 

8168.80 

745.53 

(34) 

tree 

50 

0.7 

192  x  192 

18670.30 

1573.50 

(35) 

tree 

50 

0.7 

256  x  256 

33447.74 

2526.46 

(36) 

tree 

50 

0.7 

320  x  320 

51407.10 

3821.66 

(37) 

tree 

50 

0.9 

128  x  128 

5397.86 

455.80 

(38) 

tree 

50 

0.9 

192  x  192 

12674.86 

901.80 

(39) 

tree 

50 

0.9 

256  x  256 

22907.76 

1624.02 

(40) 

tree 

50 

0.9 

320  x  320 

36279.30 

2340.57 

Table  1  :  Summary  of  the  2000  mazes  used  in  the  first  experiment 
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maze 

group 

o 

o 

II 

II 

o 

to 

II 

o 

4* 

pf  =  0.6 

00 

O 

II 

II 

b 

(1) 

1.105 

1.060 

1.060 

1.060 

1.060 

1.060 

1.071 

(2) 

1.080 

1.061 

1.061 

1.061 

1.061 

1.061 

1.074 

(3) 

1.101 

1.065 

1.065 

1.065 

1.065 

1.065 

1.073 

(4) 

1.116 

1.058 

1.058 

1.058 

1.058 

1.058 

1.075 

(5) 

1.748 

1.193 

1.193 

1.192 

1.195 

1.197 

1.267 

(6) 

1.715 

1.198 

1.198 

1.195 

1.197 

1.198 

1.249 

(7) 

1.432 

1.210 

1.207 

1207 

1.210 

1209 

1.248 

(8) 

2.351 

1.211 

1.211 

1210 

1.211 

1213 

1271 

(9) 

4.710 

1.433 

r'  1.422 

"  1.394 

1.415 

1.422 

1.579 

(10) 

4.940 

1.454 

1.435 

1.429 

1.446 

1.452 

1.583 

(11) 

3.948 

1.435 

1.428 

1.417 

1.425 

1.430 

1.561 

(12) 

6.434 

1.460 

1.438 

1.435 

1.434 

1.487 

1.656 

(13) 

10.725 

2.195 

2.023 

1.985 

1.958 

2.003 

2.488 

(14) 

11.492 

2.213 

1.99S 

1.986 

1.971 

2.031 

2.409 

05) 

13.249 

2.296 

2.055 

1.997 

2.013 

2.031 

2.453 

(16) 

16.514 

2.226 

2.037 

1.971 

1.976 

1.980 

2.348 

(17) 

17.403 

14.515 

6.241 

5.994 

6.089 

6.411 

7.505 

08) 

31.105 

12.015 

5.686 

5.066 

5.51 1 

6.144 

8.472 

(19) 

50.371 

15.597 

6.491 

5.991 

6.469 

6.392 

8.663 

(20) 

68.756 

12.093 

5.608 

5.305 

5.216 

5.581 

7.118 

Table  2a  :  Summary  of  the  results  for  Algorithm  II  on  the 
nontree  mazes  in  the  first  experiment 


Note: 


Rh  —  the  average  value  of  h-moves/min-moves  over  the  200  runs  in  each  maze 
group, 

/?//  —  =  the  average  value  of  II-moves/min-moves  over  the  200  runs  in  each  maze 
group, 


where 

h-moves  - 
If-moves  — 
min-moves  — 


the  total  number  of  physical  moves  required  by  the  agent  to 
reach  the  goal  under  hill -climbing  search, 

the  total  number  of  physical  moves  required  by  the  agent  to 
reach  the  goal  under  Algorithm  II, 

the  length  of  the  shortest  path  from  5  to  t  in  the  entire  maze. 
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Table  2b  :  Summary  of  the  results  for  Algorithm  II  on  the 
tree  mazes  in  the  first  experiment 


-  22  - 


maze 

group 

Rui 

Pf=  0.0 

Pf  -  0  2 

pf  =  0.4 

pf  =  0.6 

OO 

o 

II 

o 

II 

(1) 

1.105 

1.060 

1.060 

1.060 

1.060 

1.060 

1,071 

(2) 

1.080 

1.061 

1.061 

1.061 

1.061 

1.061 

1.074 

(3) 

1.101 

1.065 

1.065 

1.065 

1.065 

1.065 

1.073 

(4) 

1.116 

1.058 

1.058 

1.058 

1.058 

1.058 

1.075 

(5) 

1.748 

1.193 

1.193 

1.192 

1.195 

1.197 

1.267 

(6) 

1.715 

1.198 

1.198 

1.195 

1.197 

1.198 

1.249 

(7) 

1.432 

1.210 

1.207 

1.207 

1.210 

1.209 

1.248 

(8) 

2.351 

1.211 

1.211 

1.210 

1.211 

1.213 

12271 

(9) 

4.710 

1.433 

1.422  " 

1.394 

1.415 

1.422 

1.579 

(10) 

4.940 

1.454 

1.435 

1.429 

1.446 

1.452 

1.583 

(11) 

3.948 

1.435 

1.428 

1.417 

1.425 

1.430 

1.561 

(12) 

6.434 

1.460 

1.438 

1.435 

1.434 

1.487 

1.656 

(13) 

10  725 

2.195 

2.023 

1.985 

1.958 

2.003 

2488 

(14) 

11.492 

2.213 

1.998 

1.986 

1.971 

2.030 

2.409 

(15) 

13.249 

2.296 

2.055 

1.996 

2.013 

2.031 

2.453 

(16) 

16.514 

2.226 

2.037 

1.972 

1.976 

1.980 

2.348 

<1» 

17.403 

14.515 

6.242 

6.020 

6.092 

6.411 

7.505 

(18) 

31.105 

12.015 

5.686 

5.064 

5.512 

6.144 

8.472 

(19) 

50.371 

15.597 

6.491 

5.993 

6.471 

6.394 

8.663 

(20) 

68.756 

12.093 

5.608 

5.305 

5.213 

5.581 

7.118 

Table  3a  :  Summary  of  the  results  for  Algorithm  III  on  the 
nontree  mazes  in  the  first  experiment 


Note: 


Rh  --  the  average  value  of  h-moves!  min-moves  over  the  200  runs  in  each  maze 
group, 

Riu  —  =  the  average  value  of  III -moves / min-moves  over  the  200  runs  in  each  maze 
group. 


where 

h-moves  -  the  total  number  of  physical  moves  required  by  the  agent  to 
reach  the  goal  under  hill-climbing  search, 

III -moves  -  the  total  number  of  physical  moves  required  by  the  agent  to 
reach  the  goal  under  Algorithm  ID, 

min-moves  —  the  length  of  the  shortest  path  from  s  to  t  in  the  entire  maze. 


maze 


^/// 


group 

O 

o 

It 

Pf=  0.2 

Pf  =  0-4 

Pf  =  0.6 

II 

O 

oo 

II 

o 

(21) 

13.065 

38.997 

wgm 

wssu 

■  EH 

9.673 

13.065 

(22) 

13.666 

67.050 

WBm 

BH 

■  El 

13.789 

13.666 

(23) 

29.515 

95.562 

B3E9 

wSm 

Isa 

17.251 

29.515 

(24) 

23.079 

110.570 

wssn 

mam 

MS 

21.031 

23.079 

(25) 

10.059 

31.770 

msm 

10.571 

10.583 

mssM 

10.059 

(26) 

12.543 

58.243 

HH 

11.933 

12.484 

■mi 

12.543 

(27) 

51.699 

75.415 

mm 

16.174 

18.977 

18.357 

51.699 

(28) 

26.052 

109.929 

EH 

20.367 

22.071 

18.719 

26.052 

(29) 

11.863 

33.949 

9.291 

mm 
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9.384 

11.863 
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19.964 

54.030 

11.058 

13.566 

12.528 

19.964 

(31) 

17.367 

72.856 

15.579 

1ml 

15.927 

15.336 

17.367 

(32) 

22.518 

94.564 

16.875 

18.393 

20.809 

20.476 

22.518 

(33) 

10.069 

32.153 

9.023 

9.044 

msuM 

10.069 

(34) 

18.723 

46.966 

12.327 

11.729 

■ 

18.723 

(35) 

20.672 

70.423 

13.882 

15.400 

15.399 

20.672 

(36) 

46.383 

90.225 

14.504 

15.458 

18.954 

46.383 

(37) 
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(38) 
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10.447 
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30.009 

(39) 

24.401 

70.389 

13.050 

13.078 

12.920 

15.196 

24.401 

(40) 

17.953 

82.959 

13.639 

14.820 

14.2M 

13.847 

17.953 

Table  3b  :  Summary  of  the  results  for  Algorithm  III  on  the 
tree  mazes  in  the  first  experiment 
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II  >  III  -  the  number  of  times  ll-moves> III -moves  among  the  200  runs  in  each  maze  group. 
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III  >  h  --  the  number  of  times  lll-moves>h-moves  among  the  200  runs  in  each  maze  group. 
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group 

number 


grid 

dimension 


avg.  number  of 
passable  ceils 


(41) 

nontree 

50 

0.1 

128  x  128 

14735.60 

(42) 

nontree 

50 

0.1 

192  x  192 

33498.10 

(43) 

nontree 

50 

0.1 

256  x  256 

59854.94 

(44) 

non  tree 

50 

0.1 

320  x  320 

93825.78 

(45) 

nontree 

50 

0.1 

384  x  384 

135424.20 

(46) 

nontree 

50 

0.1 

448  x  448 

184573.90 

(47) 

nontree 

50 

0.1 

512  x  512 

241348.26 

(48) 

nontree 

50 

0.3 

128  x  128 

13135.72 

(49) 

nontree 

50 

0.3 

192  x  192 

29874.00 

(50) 

non  tree 

50 

0.3 

256  x  256 

53392.28 

(51) 

non  tree 

50 

0.3 

320  x  320 

83700.30 

(52) 

non  tree 

50 

0.3 

384  x  334 

120756.36 

(53) 

nontree 

50 

0.3 

448  x  448 

164621.76 

(54) 

nontree 

50 

0.3 

512  x  512 

215232.52 

nontree 

50 

0.5 

128  x  128 

nontree 

50 

0.5 

192  x  192 

nontree 

50 

0.5 

256  x  256 

non  tree 

50 

0.5 

320  x  320 

nontree 

50 

0.5 

384  x  384 

nontree 

50 

0.5 

448  x  448 

nontree 

50 

0.5 

512  x  512 

1 1825.30 


26873.38 


48046.96 


75301.88 


108664.68 


148092.66 


193664.86 


avg.  length  of 
the  shortest  paths 


81.12 


127.92 


178.71 


213.85 


248.73 


283.32 


338.12 


92.65 


132.12 


174.03 


209.69 


231.48 


306.44 


339.97 


84.90 


146.76 


172.79 


230.09 


275.99 


293.89 


336.02 


128  x  128 


192  x  192 


256  x  256 


384  x  384 


448  x  448 


512  x  512 


10476.06 

107.81 

23821.20 

142.65 

42604.00 

186.06 

66786.08 

240.72 

1 

96425.50 

i  304.05 

j 

131414.64 


171841.42 


346.17 


430.79 


(69) 

nontree 

50 

0.9 

128  x  128 

7800.44 

155.87 

(70) 

nontree 

50 

0.9 

192  x  192 

17865.94 

249.40 

(71) 

nontree 

50 

0.9 

256  x  256 

32196.04 

312.63  1 

(72) 

nontree 

50 

0.9 

320  x  320 

50536.52 

392.20  | 

(73) 

nontree 

50 

0.9 

384  x  384 

73132.48 

429.22  j 

(74) 

non  tree 

50 

0.9 

448  x  448 

99938.46 

482.32 

(75) 

nontree 

50 

0.9 

512  x  512 

130727.92 

568.87 

i  ■  _ _ _ 1 

Table  8  :  Summary  of  the  1750  mazes  used  in  the  second  experiment 
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Table  9  :  Summary  of  the  results  for  Algorithm  III  on  the 
nontree  mazes  in  the  second  experiment 


. „ 

p/=  0.40 

pf  =  0.45 

pf--  0.50 

Pf  =  0.55 

pf  =  0.60 

group 

m<h 

in=h 

m>h 

lll<h 

inch 

m=h 

m>h 

rnch 

m=h 

ni>h 

(41) 

18 

173 

9 

18 

173 

9 

18 

173 

9 

18 

173 

9 

18 

173 

9 

(42) 

31 

152 

17 

31 

152 

17 

31 

152 

17 

31 

152 

17 

31 

152 

17 

(43) 

42 

129 

29 

42 

129 

29 

42 

129 

29 

42 

129 

29 

42 

129 

29 

(44) 

39 

132 

29 

39 

132 

29 

39 

132 

29 

39 

132 

29 

39 

132 

29 

(45) 

40 

132 

28 

40 

132 

28 

40 

132 

28 

40 

132 

28 

40 

132 

28 

(46) 

51 

126 

23 

51 

126 

23 

51 

126 

23 

51 

126 

23 

51 

126 

23 

(47) 

52 

118 

30 

52 

118 

30 

52 

118 

30 

52 

118 

30 

52 

118 

30 

(48) 

100 

54 

46 

100 

54 

46 

101 

53 

46 

101 

53 

46 

101 

53 

46 

(49) 

100 

48 

52 

100 

48 

52 

100 

48 

52 

100 

48 

52 

100 

48 

52 

(50) 

110 

28 

62 

110 

28 

62 

110 

28 

62 

no 

28 

62 

109 

29 

62 

(51) 

122 

35 

43 

122 

35 

43 

122 

35 

43 

122 

35 

43 

121 

36 

43 

(52) 

124 

24 

52 

124 

24 

52 

122 

25 

53 

122 

25 

53 

120 

26 

54 

(53) 

138 

17 

45 

138 

17 

45 

137 

16 

47 

137 

16 

47 

136 

15 

49 

(54) 

135 

19 

46 

135 

19 

46 

134 

21 

45 

134 

21 

45 

134 

21 

45 

(55) 

119 

30 

51 

119 

30 

51 

119 

30 

51 

119 

30 

51 

119 

29 

52 

(56) 

138 

11 

51 

137 

11 

52 

136 

11 

53 

136 

11 

53 

135 

10 

55 

(57) 

136 

12 

52 

136 

12 

52 

137 

12 

51 

137 

12 

51 

138 

12 

50 

(58) 

153 

9 

38 

152 

7 

41 

152 

7 

41 

152 

7 

41 

151 

8 

41 

(59) 

154 

3 

43 

154 

2 

44 

152 

3 

45 

152 

3 

45 

152 

3 

45 

147 

6 

47 

147 

6 

47 

148 

4 

48 

148 

4 

48 

148 

6 

46 

(61) 

147 

4 

49 

145 

4 

51 

148 

4 

48 

1-18 

4 

48 

147 

3 

50 

(62) 

162 

3 

35 

161 

4 

35 

164 

3 

33 

165 

3 

32 

165 

4 

31 

(63) 

148 

6 

46 

146 

6 

48 

147 

7 

46 

147 

7 

46 

147 

6 

47 

(64) 

152 

1 

47 

152 

1 

47 

150 

2 

48 

150 

2 

48 

150 

2 

48 

(65) 

153 

2 

45 

154 

3 

43 

155 

2 

43 

155 

2 

43 

154 

4 

42 

(66) 

152 

2 

46 

152 

1 

47 

152 

0 

48 

151 

0 

49 

151 

1 

48 

(67) 

160 

2 

38 

164 

1 

35 

160 

2 

38 

160 

2 

38 

162 

3 

37 

(68) 

174 

0 

26 

174 

1 

25 

171 

0 

29 

171 

0 

29 

171 

0 

29 

(69) 

132 

8 

60 

133 

8 

59 

128 

8 

64 

■sa 

8 

62 

mm 

10 

61 

(70) 

154 

0 

46 

156 

0 

44 

155 

0 

45 

■£§ 

1 

47 

in 

0 

49 

(71) 

150 

2 

48 

152 

2 

46 

155 

2 

43 

■ 

2 

44 

2 

49 

(72) 

158 

1 

41 

157 

1 

42 

156 

I 

43 

2 

43 

2 

43 

(73) 

154 

0 

46 

157 

0 

43 

161 

0 

39 

0 

43 

0 

41 

(74) 

164 

0 

36 

162 

0 

38 

160 

0 

40 

0 

40 

0 

38 

(75) 

155 

1 

44 

151 

1 

48 

150 

1 

49 

1 

49 

1 

48 

Table  10  :  Comparisons  between  Algorithm  ni  and  hill-climbing  search 
for  the  nontree  mazes  in  the  second  experiment 
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Table  11  :  Average  number  of  vertex  examinations  and  heap  exchanges  required 
by  Algorithm  III  for  the  nontree  mazes  in  the  second  experiment 
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